Evaluating Human-Computer Conversation in Companions
نویسندگان
چکیده
We report on the first evaluation of the Companions project prototypes. We give preliminary results from our phase one evaluation, using known and well-understood dialogue metrics. We also give a first indication of the directions we plan to take to evaluate increasingly sophisticated conversational systems, using measures of coherence and appropriateness. 12
منابع مشابه
Evaluating Human-Machine Conversation for Appropriateness
Evaluation of complex, collaborative dialogue systems is a difficult task. Traditionally, developers have relied upon subjective feedback from the user, and parametrisation over observable metrics. However, both models place some reliance on the notion of a task; that is, the system is helping to user achieve some clearly defined goal, such as book a flight or complete a banking transaction. It...
متن کاملA New Statistical Model for Evaluation Interactive Question Answering Systems Using Regression
The development of computer systems and extensive use of information technology in the everyday life of people have just made it more and more important for them to make quick access to information that has received great importance. Increasing the volume of information makes it difficult to manage or control. Thus, some instruments need to be provided to use this information. The QA system is ...
متن کاملUsing Tangible Companions for Enhancing Learning English Conversation
In this study, the researchers attempted to extend the concept of learning companions from the virtual world to the real physical environment and made a breakthrough in technique development of tangible learning robots. The aim of this study was to explore an innovative way by combining the speech recognition technology with educational robots in the hope that the state-of-the-art technology co...
متن کاملA Framework for Simulating and Evaluating Artificial Chatter Bot Conversations
Chatter bots are computer programs that can simulate a conversation through text chat. Current chatter bots perform well in artificial conversations consisting of pairs of utterance exchanges like a questionanswer session where the context switches with every pair. But they perform poorly in longer conversations where the context is maintained across several utterance exchanges. Existing approa...
متن کاملInteraction Profiles for an Artificial Conversational Companion
Using Artificial Companions for tasks requiring long-term interaction like language learning or coaching can be approached by creating local computational models for particular interaction structures, and models reflecting changes in interaction over time. An Artificial Conversational Companion (ACC) that helps to practice conversation in a foreign language is expected to play the role of a lan...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2008